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Abstract: We discuss the existing limits on top flavour-changing neutral couplings in models with 
new vector-like quarks. Large hadron and e^e~ colliders can improve these bounds by more than one 
order of magnitude. 
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1. Introduction 

The top quark is the heaviest fermion discovered 
up to now. Its mass rrit = 173.8 ± 5.2 GeV [|l| is 
3.5 X 10^ times the electron mass and makes more 
demanding the question of why the fermion mass 
hierarchy is so large. Not to say if we compare 
rrit with the light neutrino masses. At present 
there is no compelling theoretical reason for such 
spreading. The Standard Model (SM) simply ac- 
commodates fermion masses and mixings. One 
is tempted, however, to relate the large value of 
the top mass, which is not very different from 
the electroweak symmetry breaking scale, with 
the mass generation mechanism. This and any 
other new physics are then expected to show up 
at the top first. 

In contrast, top couplings are constrained 
rather poorly by present experimental data, espe- 
cially the flavour-changing neutral (FCN) ones. 
In the SM there are no tree level FCN couplings 
and the effective ones induced at one loop are 
negligible. However, the top quark can have large 
tree level FCN couplings in models with extra 
vector-like quarks ||, H, ^. (These are fermions 
whose left-handed (LH) and right-handed (RH) 
parts have the same transformation properties 
under SU(2)i. They are present in many exten- 
sions of the SM and are the only fermions whose 
mass can be banished to high energy.) Hence, it 
is theoretically important to constrain them ex- 
perimentally. In Sections 2 and 3 we discuss the 
existing limits on these couplings in these simple 
and well-defined SM extensions |^. In Section 



4 we comment on the bounds which can be ob- 
tained at large hadron and e+e" colliders. Exist- 
ing limits will be eventually improved by at least 
one order of magnitude §, @, |, § . 

2. Model-independent limits 

Direct limits on top FCN couplings can be de- 
rived from top decays. At present the most strin- 
gent bounds result from the non-observation of 
the decays t -^ Zq, t -^ 79, t —> gq at the Fermi- 
lab Tevatron. The neutral trilinear interactions 
between the top and a light quark q are given by 
the Lagrangian 
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(2.1) 



with Pr^l = (1 ± 75)/2 and T"" the Gell-Mann 
matrices satisfying Tr {T^T'') ^ S''^ /2. Tevatron 
bounds |ll|, |l| 



Br(i -^ Zq) < 33% 
Br(t -^ -fq) < 3.2% 
Br(i -^ gq) < 15% 



(2.2) 



translate into \Xli\,\Xfl\ < 0.84, \K?J,\k?J < 



Hq 



^tq\ 



0.78, \Kjq\,\k2q\<Q.2Q,\n%\,\k%\<Q.lb. 



tq\^ \'^tq\ 



Corfu Summer Institute on Elementary Particle Physics, 1998F. del Aguila and J. A. Aguilar-Saavedra 



The effective couplings proportional to cr^j/ 



in Eq. 2.1 are absent at tree level in renormal- 
izable theories. Hence they are suppressed by 
one-loop factors ~ cx/tt, and also by the GIM 
mechanism if there are no tree- level (7;^) FCN 
couplings. Thus we will neglect them in the fol- 
lowing. However, SM extensions with vector- like 
quarks allow for large (tree-level) 7^ FCN cou- 
plings. This is so because the addition of vector- 
like quarks has little effect on radiative correc- 
tions. In particular, the new quarks decouple 
when their masses are taken to infinity. Although 
FCN couplings are constrained by precise elec- 
troweak data, indirect limits are at the mercy of 
possible cancellations between the top and other 
new particle contributions (see Ref. Ig] for an 
effective Lagrangian approach). It may be then 
convenient to derive these constraints in specific 
models. In the next Section we discuss these lim- 
its for SM extensions with vector-like fermions. 



3. Limits in extended models with 
vector-like quarks 

Let us consider a general SM extension with N 
standard families, n vector-like doublets and n„ 
up and Ud down vector-like singlets. (In prac- 
tice, our limits will be saturated in the minimal 
extensions with TV = 3 and one extra doublet 
or singlet.) The quark content of this model is 
summarized in Table |l|. The weak eigenstates are 
tlien qlj^ = {q^^^j^, g[^), with q^^^j^ doublets and 

q^^'j^ singlets, and q = u,d. 

LH doublets N + n 

RH doublets n 

up LH singlets n„ 

up RH singlets N + n„ 

down LH singlets n^ 

down RH singlets N + n^, 

Table 1: Quark content of the model 

Note that the total number of up- type quarks 
Afu = N + n + Uu and down-type quarks N'd = 
N + n + Ud do not need to be equal in gen- 
eral. As in the SM, only isodoublets have SU(2)l 
couplings, then the gauge neutral current La- 



grangian in the weak eigenstate basis can be writ- 
ten as 



2cw 
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(3.1) 



With this notation the only apparent difference 
with the SM Lagrangian is in the new RH cur- 
rents. However, when we express this Lagrangian 
in the mass eigenstate basis the particular fea- 
tures of this model manifest. In this basis, 

9 
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ulX^'^-I^'ul + UflX"^-^ 
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(3.2) 



where u = (u, c, t,T, . . .) and d — (d, s, b, B, . . .) 
are Afu and J\fd dimensional vectors, respectively. 
The X's are matrices in flavour space. Apart 
from the new RH terms, the most important dif- 
ference with the SM Lagrangian is that now the 
LH currents are not flavour diagonal, i. e. the 
AT's are nondiagonal. To show this, let us write 
the unitary transformation between the mass and 
weak interaction eigenstates, (7° = W^^qL, q% = 
W^qR, with W^ and W^ Mq x Afg unitary ma- 
trices. Then, 

vuL (1 juLx^-j juL 



XuR 
a/3 



X 



dL 

ar 

dR 

ar 



{■7 juR\^j juR 
(Uj^ ) U^p , 

i^ka T^kT ) 



(3.3) 



where (i, k) and (j, I) sum over the left- and right- 
handed doublets, respectively, a, /S = u,c,t,T, . . . 
and a,T = d,s,b,B,... In the SM, W^, W^ are 
3x3 matrices and i, k run from 1 to 3, hence 
X" ,' = Sqq' by unitarity for any mass eigen- 
states q, q' . This is the well-known GIM mecha- 
nism. Besides, A"" , ' = for there are no RH 
doublets. In general, with n > and N + n < 
Afu,Afd the X's are products of submatrices with 
less rows than columns and thus they are nondi- 
agonal in general. 

At this point one would have to wonder about 
the constraints on the A's from precise electroweak 
data, and in particular from rare processes. How- 



ever, from the apparently trivial Eqs. 3.3 we will 
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find a set of inequalities which imply limits on 
the top couplings strong enough to fulfil all ex- 
perimental data. To be definite, we work with 
W"^, and to simplify the notation, we write 



TjuL ^ I au Oc at 



hu he bt ■■ ■ 6a/; 



}N + n 
}nu 



(3.4) 



with Oq , ba column vectors (remember that N + 
n is the number of up LH doublets and n„ the 
number of up LH singlets). With this notation, 
orthogonality between columns of W"^ is written 
as aa-ap + ba-bp = Safj, and X^^ can be written 
as X^a = aa-ap with the complex scalar product 
'•' (in particular this shows that |-^^«| < 1 and 
X^^ > 0)- It is then easy to apply the Schwarz 
inequality to obtain 



(3.5) 
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and for a ^ /3, 
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The same can be done for down quarks and RH 
couplings, so we drop superscripts and write in 
complete generality 



at the CERN e+e" collider LEP and SLC |T| 
provides the diagonal X elements of the h and c 
quarks (see Ref. g] for details) . We observe that 
the values of X^„, X^^, X^^ and X^^ in Table | 
are unphysical. This is worst for XQ^^ which is 
2ct away from the physical region [0, 1], a direct 
consequence of the la discrepancy between the 
measured and the SM values of Ap^ . It is then 
necessary a careful application of the inequali- 
ties. We define the 90% C. L. upper limit on 
Xqqi as the value x such that the probability of 
finding Xqqi < x within the physical region is 
0.9. With this definition and a Monte Carlo gen- 
erator for the Gaussian distributions of Rb, Re, 
A°/g, A°/^ (correlated) and X,^^^, X^f (assum- 
ing no correlation) we obtain the bounds in Table 
pi where we also quote existing limits in the lit- 
erature |, |ll|, |l6|. 



-0.049 ± 0.026 



X^„ = 0.965 ± 0.032 

vR 

uu 

Xf^^ 1.035 ±0.022 

X^ = 0.998 ± 0.013 
Xi^ = -0.013 ±0.019 
Xj^^ = 0.996 ± 0.005 
XH = -0.039 ± 0.018 



Table 2: Diagonal elements in Eq. 3.2 



\X, 



qq' I 



\Xqq'\ < {1 - Xqq){l - Xq>q^) , 



< XqqX, 



q'q' ■ 



(3.7) 



It is important to remark that these inequali- 
ties are valid for any number of generations N ^ 
doublets n and singlets n^, rid- In particular, if 
Xqq = 0, 1, Eqs. 3/7 imply Xqqi = indepen- 
dently oi Xq'qi. In this way, Eqs. 3.7 can be seen 



as the generalization of the GIM mechanism for 
models with vector-like quarks. In the case of the 
top quark, these equations allow to derive bounds 
on Xtu, Xtc, despite our ignorance on Xu- 



To use the inequalities in Eqs. 3/? we have 
to extract the values of the diagonal elements 
Xqq from experimental data. From atomic par- 
ity violation ||, Ojand the SLAG polarized elec- 
tron experiment JMJ the diagonal X elements of 
the u and d quarks in Table || can be extracted, 
whereas the measurement of Rb, Re, ^f'b' ^fb 



It is worth to emphasize that with Eqs. 3.7 
and precise electroweak data we can set limits 
on top couplings that (z) are much stronger than 
present direct limits, and {ii) can be saturated in 
minimal SM extensions with one doublet or sin- 
glet and still fulfil all present experimental con- 
straints g. 

4. Future limits 

Improvements on the determination of the top 
FGN couplings should come from large hadron 
and e+e~ colliders. At these top factories the 
top FGN vertices manifest in top decays and in 
single top production. For a^^u vertices and large 
center of mass energies single top production is a 
more efficient way to look for FGN couplings be- 
cause the extra q^ factor in the vertex increases 
the large transverse momentum distributions im- 
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Coupling 



X' 



X' 



Source 



uc 
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1.2 X 10-3 
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0.033 


0.019 


Inequalities 


ut 


0.84 


0.84 


t^uZ 




0.28 


0.14 


Inequalities 


ct 


0.84 


0.84 


t^ cZ 




0.14 


0.16 


Inequalities 


ds 


4.1 X 10"^ 


4.1 X lO-'^ 


K+ -^ TT+VV 




0.14 


0.62 


Inequalities 


db 


1.1 X 10-3 


1.1 X 10-3 


Sjub 




0.0081 


0.062 


Inequalities 



sh 



1.9 X 10-3 
0.076 



1.9 X 10-3 B° -> n+^-X 
0.12 Inequalities 



Table 3: Present bounds on nondiagonal elements in Eq. 3.2 



proving the signal to background ratios, whereas 
in top decays the energy available is typically 
smaller and the characteristic q'^ factor makes no 
appreciable difference. For definiteness, we re- 
strict ourselves to renormalizable Ztq couplings, 
which are the relevant ones in extended models 
with vector-like quarks. (The other couplings 
can be discussed in an analogous way.) e+e- 
machines are a cleaner environment but less ef- 
ficient top factories. LEP2 can improve present 
Tevatron limits at most by a factor of 3 [O and 
Tevatron Run II with a luminosity of 2 fb-^ will 
improve LEP2 bounds by a factor of 2 ||l^. Fi- 
nally, LHC with a luminosity of 100 fb-^ will 
improve the former bounds by a factor of 20 ||l^ . 
Linear colliders will have to be consistent with 
the LHC limits but are not expected to improve 
them. However, if a sizeable coupling is found, 
linear colliders will be able to disentangle better 
the P and CP structure of the vertex. 
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